CLAIMS 

We claim: 

iNffhe method of locating objects positioned in front of a computer controlled 
display area, the method comprising: 

disputing an image having corresponding image data in the display area; 

convertingShe image data into expected captured display area data using a 
derived coordihate location function and a derived intensity function; 

capturing the imageSn an image capture area to obtain captured data that 
includes captured displW area data corresponding to a predetermined location 
of the display area in the capture area; 

comparing the expected capturecNdisplay area data to the captured display area 
data; \ 

wherein non-matching compared image qata locations correspond to locations 
of the objects. \ 

2. The method as described in Claim 1 further compnsmg deriving the coordinate 
location function by: \ 

displaying a plurality of calibration images within the cftsplay area each 
including a calibration object having an associated coordiimte location within 
the display area; \ 

capturing a plurality of images of the display area within the caprure area each 
including one of the plurality of calibration images; \ 

for each captured image, mapping the coordinate location of the calibration 
object in the display area to a coordinate location of the calibration objec&n 
the predetermined location of the display area in the capture area; and \ 
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cteriving the location function from the display area to the captured display 
area r^m the coordinate location mappings. 

The method as ascribed in Claim 2 further comprising deriving the intensity 
function by: 

displaying at least twoiotensity calibration objects in at least one image within 
the display area each having a different associated displayed intensity value; 

capturing the at least two displayed objects in the at least one image to obtain 
captured intensity values corresponding to the displayed intensity values; 

mapping the displayed intensity value^to the captured intensity values; and 

deriving the intensity function from the intensity value mappings. 

The method described in Claim 3 wherein displaced and captured intensity values 
are one of grayscale intensity values and color intensity values. 

The method described in Claim 3 further comprising oetermining a look-up table 
representative of the intensity function using interpolation. 

The method described in Claim 2 further comprising deriving the location 
function from coordinate mappings using a perspective transformation. 

The method described in Claim 6 further comprising displaying fiive or more 
calibration images and deriving the location function using a perspective 
transformation having nine associated coefficients for determining erowo 
coordinate perspective transformation. \ 

The method described in Claim 1 further comprising comparing the expeVed 
captured display area data to the portion of the captured display area data \ 
corresponding to the predetermined location of the display area by: \ 
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subh^£ting pixel values of the expected captured display area data from 
corresponding pixel values of the captured display area data to obtain 
difference daba at each coordinate location of the display area; and 

for each coordinatklocation, comparing the difference data to a threshold 
noise value to identiN the location of the. objects in front of the display area. 

9. The method as described in Olaim 8 wherein the threshold noise value is 
dependent on lighting condition^ type of image displayed, and camera quality. 

10. The method as described in Claim nwherein pixel values at non-matching 
locations of the captured display area d^ta are set to a first intensity value and the 
remaining pixel values of the captured disolay area data are set to a second 
intensity value. \ 

11. A method of calibrating a system including a computer controlled display area and 
an image capture area of an image capture devic^comprising: 

displaying a plurality of calibration images withinahe display area each 
including a calibration object having an associated Coordinate location within 
the display area; \ 

capturing a plurality of images of the display area withiimhe capture area each 
including one of the plurality of calibration images; \ 

for each captured image, mapping the coordinate location of me calibration 
object in the display area to a coordinate location of the calibration object in 
the predetermined location of the display area in the capture area\and 

deriving the location function from the coordinate location mapping!^ 

12. The method described in Claim 11 further comprising deriving the locatioi\ 
function from the mappings using a perspective transformation. \ 

13. The method described in Claim 12 further comprising displaying five or more \ 
calibration images and deriving the location function using the perspective ^ 
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transformation having nine associated coefficients for determining a two 
coordinate perspective transformation. 

14. The method as described in Claim 11 further comprising deriving the intensity 
function by: \ 

displaying at leasitwo intensity calibration objects in at least one image within 
the display area eack having a different associated displayed intensity value; 

capturing the at least tvmdisplayed intensity calibration objects in the at least 
one image to obtain captured intensity values corresponding to the displayed 
intensity values; \ 

mapping the displayed intensity Wues to the captured intensity values; and 
deriving the intensity function fromVie intensity value mappings. 

15. The method described in Claim 14 further comprising determining a look-up table 
representative of the intensity function using interpolation. 

16. A system comprising: \ 

a computing system; \ 

a display area controlled by the computing system m display an image in the 
display area having corresponding image data; \ 

an image capture device for capturing the image within ^capture area to obtain 
captured data that includes captured display area data corresponding to a 
predetermined location of the display area in the capture area: 

an object locator including: \ 

an image data converter for converting the displayed image crata into 
expected captured display area data using a derived coordinate location 
function and a derived intensity function; \ 
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^S^a means for comparing pixel values of coordinate locations of the 
expected captured display area data to corresponding coordinate 
locatiohs in the captured display area data; 

wherein non-matchnte compared image data corresponds to locations of non- 
displayed image objects^n front of the display area. 

17. The system as described in Clakn 16 wherein the coordinate mapping function is 
derived from the mappings usin^a perspective transformation. 

18. The system as described in Claim l^wherein the display area is one of a 
projection screen and a computer monitor and the image capture device is one of a 
digital still camera, a digital video cameraman analog still camera, and an analog 
video camera. \ 

19. The system as described in Claim 16 further ccwiprising a means for 
predetermining the location of the display area ii\the capture area by deriving 
constructive and destructive feedback data from image data corresponding to a 
plurality of captured calibration images. \ 

20. An apparatus for locating an object in front of a displayterea in a user interactive, 
computer controlled display system including an image c\pture device having a 
corresponding capture area comprising: \ 

a means for converting image data corresponding to an im&ge displayed in the 
display area into expected captured display area data using \ derived 
coordinate location function and a derived intensity functions 

a means for comparing pixel values of coordinate locations of t!^e expected 
captured display area data to corresponding coordinate locations m captured 
data corresponding to a predetermined location of the display area within the 
capture area; _ \ 

wherein non-matching compared image data corresponds to locations o\ 
objects in front of the display area. \ 



20 



Docket No.:10007845-1 



21. ^Pheapparatus as described in Claim 20 wherein the means for comparing pixel 
values Comprising: 

a means for subtracting expected captured display area data pixel values from 
captured display are^data to obtain a difference value for each pixel location 
of the displayed imager 

a means for comparing the difference value to a threshold value; 

wherein, for a given compared pVel location, if the absolute difference value 
is greater than the threshold value tl^en an object is located in front of the given 
pixel location. 

22. The apparatus as described in Claim 21 wh^tein the threshold value is dependent 
on lighting conditions, type of image displayecKand camera quality. 

23. The apparatus as described in Claim 20 further comprising a means for 
predetermining the location of the display area in thacapture area by deriving 
constructive and destructive feedback data from imageS^ata corresponding to a 
plurality of captured calibration images. 
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